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D scrlptlon 

The present Invention relates to translating sound segment codes representing speech, or text, in a computer 
system to synthesized speech; and more particularly to techniques used in such systems for storage and retrieval of 
s speech data. 

In text-to-speech systems, stored text in a computer is translated to synthesized speech. As can be appreciated, 
this kind of system would have wide spread application if it were of reasonable cost. For instance, a text-to-speech 
system could be used for reviewing electronic mail remotely across a telephone line, by causing the computer storing 
the electronic mail to synthesize speech representing the electronic mail. Also, such systems could be used for reading 

to to people who are visually impaired. In the word processing context, text-to-speech systems might be used to assist 
in proofreading a large document. 

However in prior art systems which have reasonable cost, the quality of the speech has been relatively poor making 
it uncomfortable to use or difficult to understand. In order to achieve good quality speech, prior art speech synthesis 
systems need specialized hardware which is very expensive, and/or a large amount of memory space in the computer 

15 system generating the sound. 

In text-to-speech systems, an algorithm reviews an input text string, and translates the words in the text string into 
a sequence of diphones which must be translated into synthesized speech. Also, text-to-speech systems analyze the 
text based on word type and context to generate intonation control used for adjusting the duration of the sounds and 
the pitch of the sounds involved in the speech. 

20 Diphones consist of a unit of speech composed of the transition between one sound, or phoneme, and an adjacent 

sound, or phoneme. Diphones typically start at the center of one phoneme and end at the center of a neighboring 
phoneme. This preserves the transition between the sounds relatively well. 

American English based text-to-speech systems, depending on the particular implementation, use about fifty dif- 
ferent sounds referred to as phones. Of these fifty different sounds, the standard language uses about 1800 diphones 

2S out of possible 2500 phone pairs. Thus, a text-to-speech system must be capable of reproducing 1800 diphones. To 
store the speech data directly for each diphone would involve a huge amount of memory. Thus, compression techniques 
have evolved to limit the amount of memory required for storing the diphones. However, to be successful, the compu- 
tational complexity of the decoder for decompressing the diphone data must be very low so that the system is capable 
of running across a broad range of hardware platforms with very high quality reproduction. 

30 Prior art systems which have addressed this problem are described in part in United States Patent No. 8,452,1 68, 

entitled COMPRESSION OF STORED WAVE FORMS FOR ARTIFICIAL SPEECH, invented by Sprague; and United 
States Patent No. 4,692,941, entitled REAL-TIME TEXT-TO-SPEECH CONVERSION SYSTEM, invented by Jacks, 
et al. Further background concerning speech synthesis may be found in United States Patent No. 4,384,169, entitled 
METHOD AND APPARATUS FOR SPEECH SYNTHESIZING, invented by Mozer, et al. 

35 Notwithstanding the prior work in this area, the use of text-to-speech systems has not gained widespread accept- 

ance. It is desirable therefore to provide a software only text-to-speech system which is portable to a wide variety of 
microcomputer platforms, and conserves memory space in such platforms for other uses. 

The present invention is defined by the appended claims and provides a real time, text-to-speech system suitable 
for application in a wide variety of personal computer platforms which uses a relatively small amount of host system 

4 o memory for execution. 

According to the invention, there is provided an apparatus for synthesizing speech in response to a sequence of 
sound segment codes representing speech, comprising memory storing a set of quantization vectors having shaped 
quantization noise spectra, said quantization vectors being generated by an inverse noise shaping filter operation 
performed on a first set of quantization vectors that correspond to the sound segment codes- 

45 

means, responsive to sound segment codes in the sequence, for identifying strings of quantization vectors in the 
set of quantisation vectors having shaped quantisation noise spectra for respective sound segment codes in the 
sequence; 

means, coupled to the means for identifying and the memory, for generating a speech data sequence in response 
50 to the strings of quantization vectors; and 

an audio transducer, coupled to the means for generating, to generate sound in response to the speech data 
sequence. 

The system is based on a speech compression algorithm which takes advantage of certain specialized knowledge 
5 $ concerning speech including the following: 

1 ) Adjacent samples of the speech data are highly correlated. Thus a fixed linear prediction filter may be used to 
partially remove the correlation between adjacent samples. 
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2) In the case of voice to speech (e.g., vowels, nasals, etc.), the speech wave forms can be regarded as slowly 
varying periodic signals. Thus, an adaptive pitch predictor can be used to remove the redundancy in speech data 
and achieve a high data compression. 

3) Finally, vector quantization is an extremely efficient approach to code correlated data vectors. It can be applied 
& to partially de-correlated speech data according to the present invention, and noise shaping can be incorporated 

into the vector quantization process to improve the subjective quality of the synthesized speech. Further, a variety 
of different compression rates can be achieved by simply varying the vector size used for vector quantization. 

Thus, according to one embodiment, the invention defined in claim 1 is an apparatus for synthesizing speech in 
10 response to a sequence of sound segment codes representing speech. The system includes a memory storing a set 
of noise compensated quantization vectors. A processing module in the apparatus is responsive to the sound segment 
codes in the sequence to identify strings of noise compensated quantization vectors in the set for respective sound 
segment codes in the sequence. A second processing module generates a speech data sequence in response to the 
strings of noise compensated quantization vectors. Finally, an audio transducer is coupled to the processing modules, 
15 and generates sound in response to the speech data sequence. 

For noise compensation according to this aspect, sounds are encoded using noise shaped data and a first set of 
quantization vectors adapted for the noise shaped data. In decoding, a second set of noise compensated vectors 
different from the first set are used to recover improved quality sound. 

Another embodiment of the invention, as claimed, additionally, involves utilizing the quantization vectors to repre- 
20 sent filtered sound segment data, and providing for a module for applying an inverse filter to the strings of quantization 
vectors in the generation of the speech data sequence. According to this aspect, the quantization vectors may represent 
a quantization of results of linear prediction filtering of sound segment data for spectral flattening to de-correlate the 
sound samples used for quantization and the quantization noise. In decompressing the sound segment data, an inverse 
linear prediction filter is applied to the identified strings of quantization vectors to recover the sound data. Also, the 
25 quantization vectors represent quantization of results of pitch filtering of sound segment data. Thus, an inverse pitch 
filter is applied to the identified strings of quantization vectors in the module of generating the speech data sequence. 

In systems using the inverse linear prediction filter and the inverse pitch filter, the sound segment codes also 
include parameters used in executing the inverse filtering steps. In the preferred system, these parameters are chosen, 
along with filter coefficients used in the decoding, so that the decoding can be executed without multiplication. That is, 
30 shifts and adds replace any multiplication required by these specifically chosen values. 

According to another aspect of the invention, there is provided an apparatus for synthesizing speech in response 
to a text, comprising: 



means for translating text to a sequence of sound segment codes; 
55 means for generating a set of quantization vectors having shaped quantization noise spectra by applying a noise 

shaping filter function is to a first set of quantization vectors that correspond to the sound segment codes; 

memory storing the set of quantization vectors having shaped quantization noise spectra; 

means, responsive to sound segment codes in the sequence, for identifying strings of quantization vectors in the 

set of quantization vectors having shaped quantization noise spectra for respective sound segment codes in the 
4 0 sequence; 

means, coupled to the means for identifying and the memory, for generating a speech data sequence in response 
to the strings of quantization vectors; and 

an audio transducer, coupled to the means for generating, to generate sound in response to the speech data 
sequence. 

45 

According to a further aspect, there is provided an apparatus for synthesizing speech in response to a text, com- 
prising: 



a programmable processor to execute routines to produce a speech data sequence; 
an audio transducer, coupled to the processor, to generate sound in response to the speech data sequence; 
a table memory, coupled to the processor, storing a noise-shaped set of quantization vectors produced by per- 
forming an inverse noise shaping filter operation on a first set of quantization vectors, and a table of encoded 
diphones having entries including data identifying a string of quantization vectors in the said noise-shaped for 
respective diphones; and 

an instruction memory, coupled to the processor, storing a translator routine for execution by the processor to 
translate the text to a sequence of diphone indices, and a decoder routine for execution by the processor including 

means, responsive to diphone indices in the sequence, for accessing the table of encoded diphones to identify 
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strings of quantization vectors in the said noise-shaped set for diphones in the text; and 
means, coupled to the means for accessing and the table memory, for retrieving the identified strings of quan- 
tization vectors; 

means, coupled with the means for retrieving, for producing diphone data strings in response to the identified 
s strings of quantization vectors, wherein the diphone data strings each have a beginning and an ending; 

means, coupled to the means for producing, for blending the ending of a particular diphone data string in the 
sequence with the beginning of an adjacent diphone data string in the sequence to smooth discontinuities 
between the particular and adjacent diphone data strings to produce a smoothed string of quantized speech 
data; and 

10 means, responsive to the text and the smoothed string of quantized speech data, for adjusting pitch and du- 

ration of the identified strings of quantization vectors for the diphones in the sequence to produce the speech 
data sequence for supply to the audio transducer. 

The invention can therefore be defined according to any of appended claims 1 3-32 as an apparatus for synthesizing 

15 speech in response to text. This system includes a module that translates received text into a sequence of sound 
segments codes which are decoded as described above. The text translator includes a table of encoded diphones 
having entries that include data identifying a string of quantization vectors in the set for the respective diphones. The 
sequence of sound segment codes thus comprises a sequence of indices to the table of encoded diphones representing 
the text. The strings of the quantization vectors for a given sound segment code are identified by accessing the entries 

20 in the table of encoded diphones. 

The module for generatihg the speech data waveform may also include modules for improving the quality of the 
synthesized speech. Such modules include a routine for blending the ending of a particular diphone in the sequence 
with beginning of an adjacent diphone to smooth discontinuities between the particular and adjacent diphone data 
strings. Further, the string of quantized speech data may be applied to a system which adjusts the pitch and duration 

25 of the sounds represented by the strings of quantization vectors. 

According to yet another embodiment of the invention, the apparatus for synthesizing speech may additionnally 
include an encoder for generating the table of encoded diphones. In this aspect, the encoder receives sampled speech 
for the respective diphones, applies a fixed linear prediction filter to partially de-correlate the speech samples and the 
quantization noise, applies a pitch filter to the output of the linear prediction filter, and applies a noise shaping filter to 

30 generate a resulting set of vectors. The resulting set of vectors is then matched to vectors in a vector quantization 
table. The vectors in the vector quantization table are related to the quantization vectors used for decoding the speech 
data by the same noise shaping filter or a derivative of it to subjectively improve the quality of the decompressed speech. 

This encoding technique allows use of the decoding technique which is very simple, requires a small amount of 
memory, and produces very high quality speech. 

35 in the text-to-speech system a higher level of compression is achieved while keeping the decoder complexity to 

an absolute minimum. The compression ratio can be varied depending on the available RAM in the computer. In order 
to store speech in an uncompressed form, normally 8-16 bits per sample is required. The number of bits required to 
store each sample can be reduced to 0.5 bits (i.e., about 16 samples of speech can be stored using 8 bits of memory). 
However, higher quality synthesized speech can be produced when larger RAM space is available, using about 4 bits 

to per sample. A speech compression/decompression technique is also described. 

Other aspects and advantages of the present invention can be seen from the detailed description of preferred 
embodiments, given by way of example only, taken in conjunction with the drawings, and the claims which follow. 

Fig. 1 is a block diagram of a generic hardware platform incorporating a text-to-speech system according to the 
present invention. 

45 Fig. 2 is a flow chart illustrating a basic text-to-speech routine according to the present invention. 

Fig. 3 illustrates the format of diphone records according to one embodiment of the present invention. 

Fig. 4 is a flow chart illustrating an encoder for speech data for use with the present invention. 

Fig. 5 is a graph discussed in reference to the estimation of pitch filter parameters in the encoder of Fig. 4. 

Fig. 6 is a flow chart illustrating the full search used in the encoder of Fig. 4. 
50 Fig. 7 is a flow chart illustrating a decoder for speech data according to the present invention. 

Fig. 8 is a flow chart illustrating a technique for blending the beginning and ending of adjacent diphone records. 

Fig. 9 consists of a set of graphs referred to in explanation of the blending technique of Fig. 8. 

Fig. 10 is a graph illustrating a typical pitch versus time diagram for a sequence of frames of speech data. 

Fig. 11 is a flow chart illustrating a technique for increasing the pitch period of a particular frame. 
55 Fig. 12 is a set of graphs referred to in explanation of the technique of Fig. 11. 

Fig. 1 3 is a flow chart illustrating a technique for decreasing the pitch period of a particular frame. 

Fig. 14 is a set of graphs referred to in explanation of the technique of Fig. 13. 

Fig. 15 is a flow chart illustrating a technique for inserting a pitch period between two frames in a sequence. 
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Fig. 16 is a set of graphs referred to in explanation of the technique of Fig. 15. 

Fig. 17 is a flow chart illustrating a techniqu for deleting a pitch period in a sequence of frames. 

Fig. 18 is a set of graphs referred to in explanation of the technique of Fig. 17. 

A detailed description of preferred embodiments of the present invention is provided with reference to the figures. 
5 Figs. 1 and 2 provide a overview of a system incorporating the present invention. Fig. 3 illustrates the basic manner 
in which diphone records are stored according to the present invention. Figs. 4-6 illustrate encoding methods based 
on vector quantization. Fig. 7 illustrates the decoding algorithm according to the present invention. 

Figs. 8 and 9 illustrate a preferred technique for blending the beginning and ending of adjacent diphone records. 
Figs. 10-18 illustrate the techniques for controlling the pitch and duration of sounds in the text-to-speech system. 

10 

I . System Overview (Figs. 1 -3) 

Fig. 1 illustrates a basic microcomputer platform incorporating a text-to-speech system based on vector quantiza- 
tion according to the present invention. The platform includes a central processing unit 10 coupled to a host system 

is bus 11 . A keyboard 1 2 or other text input device is provided in the system. Also, a display system 1 3 is coupled to the 
host system bus. The host system also includes a non-volatile storage system such as a disk drive 14. Further, the 
system includes host memory 15. The host memory includes text-to-speech (TTS) code, including encoded voice 
tables, buffers, and other host memory. The text-to-speech code is used to generate speech data for supply to an audio 
output module 16 which includes a speaker 17. 

20 According to the present invention, the encoded voice tables include a TTS dictionary which is used to translate 

text to a string of diphones. Also included is a diphone table which translates the diphones to identified strings of 
quantization vectors. A quantization vector table is used for decoding the sound segment codes of the diphone table 
into the speech data for audio output. Also, the system may include a vector quantization table for encoding which is 
loaded into the host memory 15 when necessary. 

25 The platform illustrated in Fig. 1 represents any generic microcomputer system, including a Macintosh based 

system, a DOS based system, a UNIX based system or other types of microcomputers. The text-to-speech code and 
encoded voice tables according to the present invention for decoding occupy a relatively small amount of host memory 
15. For instance, a text-to-speech decoding system according to the present invention may be implemented which 
occupies less than 640 kilobytes of main memory, and yet produces high quality, natural sounding synthesized speech. 

30 The basic algorithm executed by the text-to-speech code is illustrated in Fig. 2. The system first receives the input 

text (block 20). The input text is translated to diphone strings using the TTS dictionary (block 21 ). At the same time, 
the input text is analyzed to generate intonation control data, to control the pitch and duration of the diphones making 
up the speech (block 22). 

After the text has been translated to diphone strings, the diphone strings are decompressed to generate vector 
35 quantized data frames (block 23). After the vector quantized (VQ) data frames are produced, the beginnings and 
endings of adjacent diphones are blended to smooth any discontinuities (block 24). Next, the duration and pitch of the 
diphone VQ data frames are adjusted in response to the intonation control data (block 25 and 26). Finally, the speech 
data is supplied to the audio output system for real time speech production (block 2-7). For systems having sufficient 
processing power, an adaptive post filter may be applied to further improve the speech quality. 
40 The TTS dictionary can be implemented using any one of a variety of techniques known in the art. According to 

the present invention, diphone records are implemented as shown in Fig. 3 in a highly compressed format. 

As shown in Fig. 3, records for a left diphone 30 and a right diphone 31 are shown. The record for the left diphone 
30 includes a count 32 of the number NL of pitch periods in the diphone. Next, a pointer 33 is included which points 
to a table of length NL storing the number LPj for each pitch period, i goes from 0 to NL-1 of pitch values for corresponding 
45 compressed frame records. Finally, pointer 34 is included to point to a table 36 of ML vector quantized compressed 
speech records, each having a fixed set length of encoded frame size related to nominal pitch of the encoded speech 
for the left diphone. The nominal pitch is based upon the average number of samples for a given pitch period for the 
speech data base. 

A similar structure can be seen for the right diphone 31. Using vector quantization, a length of the compressed 
50 speech records is very short relative to the quality of the speech generated. 

The format of the vector quantized speech records can be understood further with reference to the frame encoder 
routine and the frame decoder routine described below with reference to Figs. 4-7. 

II. The Encoder/Decoder Routines (Figs. 4-7) 

55 

The encoder routine is illustrated in Fig. 4. The encoder accepts as input a frame of speech data. In the preferred 
system, the speech samples are represented as 12 or 16 bit two's complement numbers, sampled at 22,252 Hz. This 
data is divided into non-overlapping frames s n having a length of N, where N is referred to as the frame size. The value 
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of N depends on the nominal pitch of the speech data. If the nominal pitch of the recorded speech is less than 165 
samples (or 1 35 Hz), the value of N is chosen to be 96. Otherwise a frame size of 1 60 is used. The encoder transforms 
the N-point data sequence s n into a byte stream of shorter length, which depends on the desired compression rate. 
For example, if N=160 and very high data compression is desired, the output byte stream can be as short as 12 eight 
s bit bytes. A block diagram of the encoder is shown in Fig. 4. 

Thus, the routine begins by accepting a frame s n (block 50). To remove low frequency noise, such as DC or 60 
Hz power line noise, and produce offset free speech data, signal s n is passed through a high pass filter. A difference 
equation used in a preferred system to accomplish this is set out in Equation 1 for 0 < n < N. 

10 

x n = s n - S n-1 + °" 9 * Vi Equation 1 

The value x n is the "offset free" signal. The variables s^ and x 0 are initialized to zero for each diphone and are 
subsequently updated using the relation of Equation 2. 

15 

x.i = * N and s^ = s N Equation 2 



This step can be referred to as offset compensation or DC removal (block 51). 

In order to partially decorrelate the speech samples and the quantization noise, the sequence x„ is passed through 
a fixed first order linear prediction filter. The difference equation to accomplish this is set forth in Equation 3. 



v n =x n- a875 *Vi Equation 3 

The linear prediction filtering of Equation 3 produces a frame y n (block 52). The filter parameter, which is equal to 
0.875 in Equation 3, will have to be modified if a different speech sampling rate is used. The value of x.., is initialized 
to zero for each diphone, but will be updated in the step of inverse linear prediction filtering (block 60) as described 
below. 

It is possible to use a variety of filter types, including, for instance, an adaptive filter in which the filter parameters 
are dependent on the diphones to be encoded, or higher order filters. 

The sequence y n produced by Equation 3 is then utilized to determine an optimum pitch value, P opt . and an asso- 
ciated gain factor, p. P opt is computed using the functions s^P), s xx (P), Syy(P), and the coherence function Coh(P) 
defined by Equations 4, 5, 6 and 7 as set out below. 



N-1 

V P > - Z y n - PBUF P m , ■ P ♦ n 
n=0 max 



Equation 4 



45 



N-1 
n = 0 



S xx< P) = Z V n *V n 



50 

Equation 5 



55 
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N-1 

s (P) = I PBUF • PBUF . 

7 f N = 0 max max 

Equation 6 



and 



Coh(P) = Sxy (P) * Sxy (P) / (s xx (P) * s yy (P)) Equation 7 

PBUF is a pitch buffer of size P max , which is initialized to zero, and updated in the pitch buffer update block 59 as 
described below. P opt is the value of P for which Coh(P) is maximum and s^P) is positive. The range of P considered 
depends on the nominal pitch of the speech being coded. The range is (96 to 350) if the frame size is equal to 96 and 
is (160 to 414) if the frame size is equal to 160. P max is 350 if nominal pitch is less than 160 and is equal to 414 
otherwise. The parameter P opt can be represented using 8 bits. 

The computation of P opt can be understood with reference to Fig. 5. In Fig. 5, the buffer PBUF is represented by 
20 the sequence 100 and the frame y n is represented by the sequence 101. In a segment of speech data in which the 
preceding frames are substantially equal to the frame y n . PBUF and y n will look as shown in Fig. 5. P opt will have the 
value at point 102, where the vector y n 101 matches as closely as possible a corresponding segment of similar length 
in PBUF 100. 

The pitch filter gain parameter p is determined using the expression of Equation 8. 



P = s xy( p op t) 1 s yy( P o P t)- Equation 8 

P is quantized to four bits, so that the quantized value of p can range from 1/16 to 1 , in steps of 1/16. 
Next, a pitch filter is applied (block 54). The long term correlations in the pre-emphasized speech data y n are 
removed using the relation of Equation 9. 

r n = v n " P * pbuf p .p +n« 0<n<N. Equation 9 

max opt 



This results in computation of a residual signal r n . 

Next, a scaling parameter G is generated using a block gain estimation routine (block 55). In order to increase the 
computational accuracy of the following stages of processing, the residual signal r n is rescaled. The scaling parameter, 
4Q G, is obtained by first determining the largest magnitude of the signal r n and quantizing it using a 7-level quantizer. 
The parameter G can take one of the following 7 values: 256, 512, 1024, 2048, 4096, 8192, and 16384. The conse- 
quence of choosing these quantization levels is that the rescaling operation can be implemented using only shift op- 
erations. 

Next the routine proceeds to residual coding using a full search vector quantization code (block 56). In order to 
4S code the residual signal r n , the n point sequence r n is divided into non-overlapping blocks of length M, where M is 
referred to as the "vector size". Thus, M sample blocks by are created, where i is an index from zero to M- on the block 
number, and j is an index from zero to N/M-1 on the sample within the block. Each block may be defined as set out in 
Equation 10. 



b ij = W (0 £ i < N/M and j < 0 < M) Equation 10 



Each of these M sample blocks by will be coded into an 8 bit number using vector quantization. The value of M 
depends on the desired compression ratio. For example, with M equal to 16, very high compression is achieved (i.e., 
55 16 residual samples are coded using only 8 bits). However, the decoded speech quality can be perceived to be some- 
what noisy with M=16. On the other hand, with M=2, the decompressed speech quality will be very close to that of 
uncompressed speech. However the length of the compressed speech records will be longer. In the preferred inple- 
mentation, the value M can take values 2, 4, 8 and 16. 
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The vector quantization is performed as shown in Fig. 6. Thus, for all blocks by a sequence of'quantization vectors 
is identified (block 120). First, the components of block by are passed through a noise shaping filter and scaled as set 
out in Equation 11 (block 121). 

w j = 0.875 * w M -0.5 * Wj_ 2 + 0.4375 * + b^, 0 < j < M 

Vy = G * Wj 0 < j < M Equation 1 1 

Thus, Vy is the jth component of the vector v r and the values w^, w. 2 and w . 3 are the states of the noise shaping 
filter and are initialized to zero for each diphone. The filter coefficients are chosen to shape the quantization noise 
spectra in order to improve the subjective quality of the decompressed speech. After each vector is coded and decoded, 
these states are updated as described below with reference to blocks 124-126. 

Next, the routine finds a pointer to the best match in a vector quantization table (block 1 22). The vector quantization 
table 123 consists of a sequence of vectors C 0 through C 255 (block 123). 

Thus, the vector Vj is compared against 256 M-point vectors, which are precomputed and stored in the code table 
123. The vector C qj which is closest to Vj is determined according to Equation 12. The value C p for p =0 through 255 
represents the p lh encoding vector from the vector quantization code table 1 23. 

M-1 

min Z (v.. - C .) 2 
P J = 0 

Equation 12 

The closest vector C qi can also be determined efficiently using the technique of Equation 13. 

Vj T • C qj <; V; T • C p for all p(0 <; p <, 255) Equation 1 3 



In Equation 1 3, the value v T represents the transpose of the vector v, and represents the inner product operation 
in the inequality. 

The encoding vectors C p in table 123 are utilized to match on the noise filtered value Vy. However in decoding, a 
decoding vector table 125 is used which consists of a sequence of vectors QV p . The values QV p are selected for the 
purpose of achieving quality sound data using the vector quantization technique. Thus, after finding the vector C qjl the 
pointer q is utilized to access the vector QV qi . The decoded samples corresponding to the vector b| which is produced 
^ at step 55 of Fig. 4, is the M-point vector (1/G) * QV qj . The vector C p is related to the vector QV p by the noise shaping 
filter operation of Equation 11 . Thus, when the decoding vector QV p is accessed, no inverse noise shaping filter needs 
to be computed in the decode operation. The table 1 25 of Fig. 6 thus includes noise compensated quantization vectors. 

In continuing to compute the encoding vectors for the vectors b^ which make up the residual signal r n , the decoding 
vector of the pointer to the vector bj is accessed (block 1 24). That decoding vector is used for filter and PBUF updates 
(block 126). 

For the noise shaping filter, after the decoded samples are computed for each sub-block bj, the error vector (b r 
QV qj ) is passed through the noise shaping filter as shown in Equation 14. 



Wj = 0.875 * W H - 0.5 + W h2 + 0.4375 * + [b y - QV qj (j)] 

0£j<M Equation 14 

In Equation 14, the value QV qj (j) represents the j ,h component of the decoding vector QV qj . The noise shaping 
filter states for the next block are updated as shown in Equation 15. 
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W -2 " W M-2 

w -3 " w m-3 Equation 15 

This coding and decoding is performed for all of the N/M subblocks to obtain N/M indices to the decoding vector 
table 1 25. This string of indices Q n , for n going from zero to N/M-1 represent identifiers for a string of decoding vectors 
for the residual signal r n . 

Thus, four parameters represent the N-point data sequence y n : 

1 ) ) Optimum pitch, P opt (8 bits), 

2) Pitch filter gain, p (4 bits), 

3) Scaling parameter, G (3 bits), and 

4) A string of decoding table indices, Q n (0 <, n < N/M). 

The parameters p and G can be coded into a single byte. Thus, only (N/M) plus 2 bytes are used to represent N 
samples of speech. For example, suppose nominal pitch is 100 samples long, and M=16. In this case, a frame of 96 
samples of speech are represented by 8 bytes: 1 byte for P opf 1 byte for P and G, and 6 bytes for the decoding table 
indices Q n . If the uncompressed speech consists of 16 bit samples, then this represents a compression of 24:1. 

Back to Fig. 4, four parameters identifying the speech data are stored (block 57). In a preferred system, they are 
stored in a structure as described with respect to Fig. 3 where the structure of the frame can be characterized as follows: 



#define NumOfVectorsPerFrame (FrameSize / VectorSize) 

struct frame { 

unsigned Gain : 4; 

unsigned Beta : 3; 

unsigned UnusedBit: 1; 

unsigned char Pitch ; 

unsigned char VQcodes[fSlumOfVectorsPerFrame]; }; 

The diphone record of Fig. 3 utilizing this frame structure can be characterized as follows: 

DiphoneRecord 
{ 

char LeftPhone, RightPhone; 

short LeftPitchPeriodCount,RightPitchPeriodCount; 
short *LeftPeriods, *RightPeriods; 
^ struct frame *LeftData, *RightData; 

These stored parameters uniquely provide for identification of the diphones required for text-to-speech synthesis. 

As mentioned above with respect to Fig. 6, the encoder continues decoding the data being encoded in order to 
update the filter and PBUF values. The first step involved in this is an inverse pitch filter (block 58). With the vector r' n 
corresponding to the decoded signal formed by concatenating the string of decoding vectors to represent the residua" 
signal r' n , the inverse filter is implemented as set out in Equation 16. 

V'n = r ' n + P * PBUF Pmax - Popt + n 0 £ n < N. Equation 1 6 

Next, the pitch buffer is updated (block 59) with the output of the inverse pitch filter. The pitch buffer PBUF is 
updated as set out in Equation 1 7. 
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PBUF n = PBUF (n + N) 0sn<(P max -N) 

PBUF (Pmax - n ♦ n) = V'n 0 * n < N Equation 1 7 

Finally, the linear prediction filter parameters are updated using an inverse linear prediction filter step (block 60). 
The output of the inverse pitch filter is passed through a first order inverse linear prediction filter to obtain the decoded 
speech. The difference equation to implement this filter is set out in Equation 18. 

x' n = 0.875 * x'^ + y* n Equation 18 



In Equation 18, x' n is the decompressed speech. From this, the value of x.., for the next frame is set to the value 
x N for use in the step of block 52. 

Fig. 7 illustrates the decoder routine. The decoder module accepts as input (N/M) + 2 bytes of data, generated by 
the encoder module, and applies as output N samples of speech. The value of N depends on the nominal pitch of the 
speech data and the value of M depends on the desired compression ratio. 

In software only text-to-speech systems, the computational complexity of the decoder must be as small as possible 
to ensure that the text-to-speech system can run in real time even on slow computers. A block diagram of the decoder 
is shown in Fig. 7. 

The routine starts by accepting diphone records at block 200. The first step involves parsing the parameters G, p, 
P opt , and the vector quantization string Q n (block 201 ). Next, the residual signal r' n is decoded (block 202). This involves 
accessing and concatenating the decoding vectors for the vector quantization string as shown schematically at block 
203 with access to the decoding quantization vector table 125. 

After the residual signal r* n is decoded, an inverse pitch filter is applied (block 204). This inverse pitch filter is 
implemented as shown in Equation 19: 



y' n = r n + P*SPBUF(P max - P opt + n), 0 ^n < N. Equation 1 9 

SPBUF is a synthesizer pitch buffer of length P max initialized as zero for each diphone, as described above with respect 
to the encoder pitch buffer PBUF. 

For each frame, the synthesis pitch buffer is updated (block 205). The manner in which it is updated is shown in 
Equation 20: 

SPBUF n = SPBUF (n + N) 0<n<P max -N) 

SPBUF (Pmax - N + n) = y'n 0 * " <N Equation 20 

40 

After updating SPBUF, the sequence y' n is applied to an inverse linear prediction filtering step (block 206). Thus, 
the output of the inverse pitch filter y* n is passed through a first order inverse linear prediction filter to obtain the decoded 
speech. The difference equation to implement the inverse linear prediction filter is set out in Equation 2i : 

45 

x' n = 0.875 * x'^ + y' n Equation 21 

In Equation 21 , the vector x* n corresponds to the decompressed speech. This filtering operation can be implement- 
50 ed using simple shift operations without requiring any multiplication. Therefore, it executes very quickly and utilizes a 
very small amount of the host computer resources. 

Encoding and decoding speech according to the algorithms described above, provide several advantages over 
prior art systems. First, this technique offers higher speech compression rates with decoders simple enough to be used 
in the implementation of software only text-to-speech systems on computer systems with low processing power. Sec- 
55 ond, the technique offers a very flexible trade-off between the compression ratio and synthesizer speech quality. A 
high-end computer system can opt for higher quality synthesized speech at the expense of a bigger RAM memory 
requirement. 
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III. Waveform Blending For Discontinuity Smoothing (Figs. 8 and 9) 

As mentioned above with respect to Fig. 2, the synthesized frames of speech data generated using the vector 
quantization technique may result in slight discontinuities between diphones in a text string. Thus, the text-to-speech 
s system provides a module for blending the diphone data frames to smooth such discontinuities. The blending technique 
of the preferred embodiment is shown with respect to Figs. 8 and 9. 

Two concatenated diphones will have an ending frame and a beginning frame. The ending frame of the left diphone 
must be blended with the beginning frame of the right diphone without audible discontinuities or clicks being generated. 
Since the right boundary of the first diphone and the left boundary of the second diphone correspond to the same 
io phoneme in most situations, they are expected to be similar looking at the point of concatenation. However, because 
the two diphone codings are extracted from different context, they will not look identical. This blending technique is 
applied to eliminate discontinuities at the point of concatenation. In Fig. 9, the last frame, referring here to one pitch 
period, of the left diphone is designated L n (0<n<PL) at the top of the page. The first frame (pitch period) of the right 
diphone is designated R n (0<n<PR). The blending of and R n according to the present invention will alter these two 
75 pitch periods only and is performed as discussed with reference to Fig. 8. The waveforms in Fig. 9 are chosen to 
illustrate the algorithm, and may not be representative of real speech data. 

Thus, the algorithm as shown in Fig. 8 begins with receiving the left and right diphone in a sequence (block 300). 
Next, the last frame of the left diphone is stored in the buffer L n (block 301). Also, the first frame of the right diphone 
is stored in buffer R n (block 302). 
20 Next, the algorithm replicates and concatenates the left frame to form extend frame (block 303). In the next 

step, the discontinuities in the extended frame between the replicated left frames are smoothed (block 304). This 
smoothed and extended left frame is referred to as El n in Fig. 9. 

The extended sequence El n (0^ n < PL) is obtained in the first step as shown in Equation 22: 
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El n =L n n = 0,1,...,PL-1 



e, pl + n = L n n = 0,1 ,...,PL-1 Equation 22 

Then discontinuity smoothing from the point n = P L is conducted according to the filter of Equation 23: 

Et n . + n = EW*n+[EWi)-EIVi)rA B * 1 . 
35 n = 0,1,...,(PL/2). Equation 23 

In Equation 23, the value A is equal to 1 5/16 and E\\ PL . n = El 2 + 3 * (El r EI 0 ). Thus, as indicated in Fig. 9, the extended 
sequence El n is substantially equal to L n on the left hand side, has a smoothed region beginning at the point P L and 
converges on the original shape of L n toward the point 2P L . If L n was perfectly periodic, then Elp,^ = El^. 

In the next step, the optimum match of R n with the vector El n is found. This match point is referred to as P opt . 
(Block 305.) This is accomplished essentially as shown in Fig. 9 by comparing R n with El n to find the section of El n 
which most closely matches R n . This optimum blend point determination is performed using Equation 23 where W is 
the minimum of PL and PR, and AMDF represents the average magnitude difference function. 



W-1 

AMDF(p) = Z I El - R | 

n + p n 1 

n = 0 Equation 24 

This function is computed for values of p in the range of 0 to PL-1 . The vertical bars in the operation denote the 
absolute value. W is the window size for the AMDF computation. P opt is chosen to be the value at which AMDF(p) is 
minimum. This means that p = P opt corresponds to the point at which sequences El n+p (0<n<W) and R n (0<n<W) are 
very close to each other. 

After determining the optimum blend point P opt , the waveforms are blended (block 306). The blending utilizes a 
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first weighting ramp WL which is shown in Fig. 9 beginning at P opt in the El n trace. In a second ramp, WR is shown in 
Fig. 9 at the R n trace which is lined up with P opt . Thus, in the beginning of the blending operation, the value of El ft is 
emphasized. At the end of the blending operation, the value of R n is emphasized. 

Before blending, th length PL of !_„ is altered as needed to ensure that when the modified !_„ and R n are concate- 
s nated, the waveforms are as continuous as possible. Thus, the length P'L is set to P opt if P opt is greater than PL/2. 
Otherwise, the length P'L is equal to W + P opt and the sequence L n is equal to El n for 0<n<(P'L-1). 

The blending ramp beginning at P opt is set out in Equation 25: 

,0 R n = E, n + Popt + (Rn " El n + Popt)*( n+1 VW 0 < n < W 

R = R n W <> n < PR Equation 25 



Thus, the sequences L n and R n are windowed and added to get the blended R n . The beginning of L n and the 
15 ending of R n are preserved to prevent any discontinuities with adjacent frames. 

This blending technique is believed to minimize blending noise in synthesized speech produced by any concate- 
nated speech synthesis. 

IV. Pitch and Duration Modification (Figs. 10-18) 

20 

As mentioned above with respect to Fig. 2, a text analysis program analyzes the text and determines the duration 
and pitch contour of each phone that needs to be synthesized and generates intonation control signals. A typical control 
for a phone will indicate that a given phoneme, such as AE, should have a duration of 200 milliseconds and a pitch 
should rise linearly from 220Hz to 300Hz. This requirement is graphically shown in Fig. 10. As shown in Fig. 10, T 

25 equals the desired duration (e.g. 200 milliseconds) of the phoneme. The frequency f b is the desired beginning pitch in 
Hz. The frequency f e is the desired ending pitch in Hz. The labels P v P 2 ...,P6 indicate the number of samples of each 
frame to achieve the desired pitch frequencies f b , f 2 ...,f 6 . The relationship between the desired number of samples, Pj, 
and the desired pitch frequency fj (f , = f b ), is defined by the relation: 

Pj = Fg/fj, where F s is the sampling frequency for the data. As can be seen in Fig. 10, the pitch period for a lower 

30 frequency period of the phoneme is longer than the pitch period for a higher frequency period of the phoneme. If the 
nominal frequency were P 3 , then the algorithm would be required to lengthen the pitch period for frames and P 2 
and decrease the pitch periods for frames P 4 , P 5 and P 6 . Also, the given duration T of the phoneme will indicate how 
many pitch periods should be inserted or deleted from the encoded phoneme to achieve the desired duration period. 
Figs. 11 through 18 illustrate a preferred implementation of such algorithms. 

35 Fig. 1 1 illustrates an algorithm for increasing the pitch period, with reference to the graphs of Fig. 1 2. The algorithm 

begins by receiving a control to increase the pitch period to N + A, where N is the pitch period of the encoded frame. 
(Block 350). In the next step, the pitch period data is stored in a buffer x n (block 351 ). x n is shown in Fig. 1 2 at the top 
of the page. In the next step, a left vector L n is generated by applying a weighting function WL to the pitch period data 
x n with reference to A (block 352). This weighting function is illustrated in Equation 26 where M = N-A: 

L n = x n for 0 < n < A 
L n = x n * (N- n V(M + 1 ) for A <> n < N Equation 26 

45 

As can be seen in Fig. 12, the weighting function WL is constant from the first sample to sample A, and decreases 
from A to N. 

Next, a weighting function WR is applied to x n (block 353) as can be seen in the Fig. 12. This weighting function 
is executed as shown in Equation 27: 

50 

R n = x n + a *( n+1 ) for 0 £ n < N-A 

R n = X n + A for N-A ^ n < N. Equation 27 

55 

As can be seen in Fig. 12, the weighting function WR increases from 0 to N-A and remains constant from N-A to 
N. The resulting waveforms L n and R n are shown conceptually in Fig. 12. As can be seen, maintains the beginning 
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of the sequence x n , while R n maintains the ending of the data x n . 

The pitch modified sequence y n is formed (block 354) by adding the two sequences as shown in Equation 28: 

y n = L n + R (n-A) Equation 28 

This is graphically shown in Fig. 12 by placing R n shifted by A below L n . The combination of L n and R n shifted by A is 
shown to be y n at the bottom of Fig. 1 2. The pitch period for y n is N + A. The beginning of y n is the same as the beginning 
of x n , and the ending of y n is substantially the same as the ending of x n . This maintains continuity with adjacent frames 
in the sequence, and accomplishes a smooth transition while extending the pitch period of the data. 

Equation 28 is executed with the assumption that L n is 0, for n<N, and R n is 0 for n<0. This is illustrated pictorially 
in Fig. 12. 

An efficient implementation of this scheme which requires at most one multiply per sample, is shown in Equation 29: 



y n = x n 0<n<A 
Vn = x n + t X n-A " X J *( n ' A + 1 V(N-A + 1) A < n < N 
20 y n =x n-A N<n<N d Equation 29 

This results in a new pitch period having a pitch period of N + A. 

There are also instances in which the pitch period must be decreased. The algorithm for decreasing the pitch 
period is shown in Fig. 13 with reference to the graphs of Fig. 14. Thus, the algorithm begins with a control signal 
indicating that the pitch period must be decreased to N-A. (Block 400). The first step is to store two consecutive pitch 
periods in the buffer x n (block 401). Thus, the buffer x n as can be seen in Fig. 14 consists of two consecutive pitch 
periods, with the period N, being the length of the first pitch period, and N r being the length of the second pitch period. 
Next, two sequences L n and R n are conceptually created using weighting functions WL and WR (blocks 402 and 403). 
The weighting function WL emphasizes the beginning of the first pitch period, and the weighting function WR empha- 
sizes the ending of the second pitch period. These functions can be conceptually represented as shown in Equations 
30 and 31, respectively: 



L n = x n for0^n<N,-W 
L n = x n*(N,-n)/(W+1) W<n<N, 

L n = 0 otherwise. Equation 30 

and 

R n = x n * (n-N,+W-A+1)/(W+ 1) for N, - W + A < n < N, + A 
45 R n =x n forN, + A<n<N, + N r 

R n = 0 otherwise. Equation 31 

In these equations, A is equal to the difference between N, and the desired pitch period N d . The value W is equal 
to 2*A, unless 2* A is greater than N d , in which case W is equal to N d . 

These two sequences L„ and R n are blended to form a pitch modified sequence y n (block 404). The length of the 
pitch modified sequence y n will be equal to the sum of the desired length and the length of the right phoneme frame 
N r It is formed by adding the two sequences as shown in Equation 32: 

y n = L n + R (n + a) Equation 32 
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Thus, when a pitch period is decreased, two consecutive pitch periods of data are affected, even though only the 
length of one pitch period is changed. This is done because pitch periods are divided at places where short-term energy 
is the lowest within a pitch period. Thus, this strategy affects only the low energy portion of the pitch periods. This 
minimizes the degradation in speech quality due to the pitch modification. It should be appreciated that the drawings 
5 in Fig. 14 are simplified and do not represent actual pitch period data. 

An efficient implementation of this scheme, which requires at most one multiply per sample, is set out in Equations 
33 and 34. 

The first pitch period of length N d is given by Equation 33: 

10 

y n = x n 0<n<N,-W 
v n = x n + I x n + a * x rJ*( n " N i + w + 1 V( w + 1 ) N, - W < n < N d Equation 33 

75 The second pitch period of length N r is generated as shown in Equation 34: 



Vn = Va + I X n - Va^^A-N, + W + 1 V( W +1) N, < n < N, + A 

20 yn = x n N i+A- n<N i + N r Equation 34 



As can be seen in Fig. 14, the sequence is essentially equal to the first pitch period until the point N,-W. At that 
point, a decreasing ramp WL is applied to the signal to dampen the effect of the first pitch period. 

As also can be seen, the weighting function WR begins at the point N r W + A and applies an increasing ramp to 
the sequence x n until the point N, + A From that point, a constant value is applied. This has the effect of damping the 
effect of the right sequence and emphasizing the left during the beginning of the weighting functions, and generating 
an ending segment which is substantially equal to the ending segment of x„ emphasizing the right sequence and 
damping the left. When the two functions are blended, the resulting waveform y n is substantially equal to the beginning 
of x n at the beginning of the sequence. At the point N,-W a modified sequence is generated until the point N,. From N, 
to the ending, sequence x n shifted by A results. 

A need also arises for insertion of pitch periods to increase the duration of a given sound. A pitch period is inserted 
according to the algorithm shown in Fig. 1 5 with reference to the drawings of Fig. 16. 

The algorithm begins by receiving a control signal to insert a pitch period between frames L„ and R n (block 450). 
Next, both L n and R n are stored in the buffer (block 451), where L n and R n are two adjacent pitch periods of a voice 
diphone. (Without loss of generality, it is assumed for the description that the two sequences are of equal lengths N.) 

In order to insert a pitch period, x n of the same duration, without causing a discontinuity between L n and x n and 
between x n and R n> the pitch period x n should resemble R n around n =0 (preserving L n to x n continuity), and should 
resemble L n around n = N (preserving x n to R n continuity). This is accomplished by defining x n as shown in Equation 35: 

x n = R n + ( L n " R n > * K n + 1 V( N + 1 )1 0 < n < N-1 Equation 35 
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Conceptually, as shown in Fig. 15, the algorithm proceeds by generating a left vector WL(L n ), essentially applying 
to the increasing ramp WL to the signal L n . (Block 452). 

A right vector WR (R n ) is generated using the weighting vector WR (block 453) which is essentially a decreasing 
ramp as shown in Fig. 16. Thus, the ending of L„ is emphasized with the left vector, and the beginning of R n is em- 
phasized with the vector WR. 

Next, WR (L n ) and WR (R n ) are blended to create an inserted period x n (block 454). 

The computation requirement for inserting a pitch period is thus just a multiplication and two additions per speech 
sample. 

Finally, concatenation of L n , x n and R n produces a sequence with an inserted pitch period (block 455). 

Deletion of a pitch period is accomplished as shown in Fig. 1 7 with reference to the graphs of Fig. 1 8. This algorithm, 
which is very similar to the algorithm for inserting a pitch period, begins with receiving a control signal indicating deletion 
of pitch period R n which follows L n (block 500). Next, the pitch periods L n and R n are stored in the buffer (block 501 ). 
This is pictorially illustrated in Fig. 18 at the top of the page. Again, without loss of generality, it is assumed that the 
two sequences have equal lengths N. 

The algorithm operates to modify the pitch period !_„ which precedes R n (to be deleted) so that it resembles R n , 
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as n approaches N. This is done as set forth in Equation 36: 
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L 'r> = L n + < R n " L n) * Rn+1 V(N+1)] 0 £ n < N-1 Equation 36 

In Equation 36, the resulting sequence L' n is shown at the bottom of Fig. 18. Conceptually, Equation 36 applies a 
weighting function WL to the sequence L n (block 502). This emphasizes the beginning of the sequence L n as shown. 
Next, a right vector WR (R n ) is generated by applying a weighting vector WR to the sequence R n that emphasizes the 
ending of R n (block 503). 

WL (L n ) and WR (R n ) are blended to create the resulting vector L' n . (Block 504). Finally, the sequence L n -R n is 
replaced with the sequence L' n in the pitch period string. (Block 505). 

IV. Conclusion 

Accordingly, the present invention presents a text-to-speech system or system for translating sound segment codes 
representing speech, to speech, which is efficient, uses a very small amont of memory, and is portable to a wide variety 
of standard microcomputer platforms. It takes advantage of knowledge about speech data, and to create a speech 
compression, blending, and duration control routine which produces very high quality speech with very little computa- 
tional resources. 

Software can be used for executing the compression and decompression, the blending, and the duration and pitch 
control routines. 

The foregoing description of preferred embodiments of the present invention has been provided for the purposes 
of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. 
Obviously, many modifications and variations within the scope of the claims will be apparent to practitioners skilled in 
this art. The embodiments were chosen and described in order to best explain the principles of the invention and its 
practical application, thereby enabling others skilled in the art to understand the invention for various embodiments 
and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the 
invention be defined by the following claims. 

Claims 

1. An apparatus for synthesizing speech in response to a sequence of sound segment codes representing speech, 
comprising memory (15) storing a set (25) of quantization vectors (QV p ) having shaped quantization noise spectra, 
said quantization vectors being generated by an inverse noise shaping filter operation performed on a first set 
(123) of quantization vectors (C p ) that correspond to the sound segment codes; 

means (200,10), responsive to sound segment codes in the sequence, for identifying (203) strings of quanti- 
zation vectors in the set (125) of quantization vectors (QV p ) having shaped quantization noise spectra for 
respective sound segment codes in the sequence; 

means (10), coupled to the means for identifying and the memory (15), for generating (204,205,206) a speech 
data sequence in response to the strings of quantization vectors; and 

an audio transducer ( 1 6,17), coupled to the means for generating, to generate sound in response to the speech 
data sequence. 

2. The apparatus of claim 1 , wherein the sound segment codes comprise data encoded using the first set of quanti- 
zation vectors, and the set (1 25) of quantization vectors (QV p ) having shaped quantization noise spectra is different 
from the first set (123) of quantization vectors (C p ) but related to it according to the noise shaping filter operation. 
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The apparatus of claim 1 or 2, wherein the first set of quantization vectors represent quantization of filtered sound 
segment data, and the means for generating a speech data sequence includes; 

means for applying an inverse filter to the identified strings of quantization vectors in generation of the speech 
data sequence. 

The apparatus of claim 3, wherein the inverse filter includes parameters chosen so that any multiplies are replaced 
by shift and/or add operations in application of the inverse filter. 
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5. The apparatus of claim 1 or 2, wherein the first set of quantization vectors represent quantization of results of linear 
prediction filtering of sound segment data, and the means for generating a speech data sequence includes; 

means for applying an inverse linear prediction filter to the identified strings of quantization vectors in gen- 
eration of the speech data sequence. 

6. The apparatus or claim 1 or 2 or 5, wherein the first set of quantization vectors represent quantization of results 
of pitch filtering of sound segment data, and the means for generating a speech data sequence includes; 

means for applying an inverse pitch filter to the identified strings of quantization vectors in generation of the 
speech data sequence. 

7. The apparatus of any preceding claim, wherein the means for generating a speech data sequence includes: 

means for concatenating the identified strings of quantization vectors and supplying the concatenated strings 
for the speech data sequence. 

8. The apparatus of any preceding claim, wherein the identified strings of quantization vectors each have a beginning 
and an ending, and means for generating a speech data sequence includes; 

means for supplying the identified strings of quantization vectors for respective sound segment codes in se- 
quence; and 

means for blending the ending of an identified string of quantization vectors of a particular sound segment 
code in the sequence with the beginning of an identified string of quantization vectors of an adjacent sound 
segment code in the sequence to smooth discontinuities between the particular and adjacent sound segment 
codes in the speech data sequence. 

9. The apparatus of any preceding claim, wherein the means for generating a speech data sequence includes; 

means, responsive to the sound segment codes for adjusting pitch and duration of the identified strings of 
quantization vectors in the speech data sequence. 

10. The apparatus of any preceding claim further including an encoder including: 

a store for an encoding set of quantization vectors different from the set of quantization vectors used in de- 
coding; and 

means for generating the sound segment codes in response to the encoding set and sound segment data. 

11. The apparatus of claim 10, wherein the encoder further includes a linear prediction filter. 

12. The apparatus of claim 10 or 11, wherein the encoder further includes a pitch filter. 

13. An apparatus for synthesizing speech in response to a text, comprising: 

means for translating text to a sequence of sound segment codes; 

means for generating a set (125) of quantization vectors (QV p ) having shaped quantization noise spectra by 
applying an inverse noise shaping filter function to a first set (1 23) of quantization vectors (C p ) that correspond 
to the sound segment codes; 

memory (15) storing the set (125) of quantization vectors (QV p ) having shaped quantization noise spectra; 
means (10), responsive to sound segment codes in the sequence, for identifying (203) strings of quantization 
vectors in the set (125) of quantization vectors (QV p ) having shaped quantization noise spectra for respective 
sound segment codes in the sequence; 

means (1 0), coupled to the means for identifying and the memory (1 5), for generating (204,205,206) a speech 
data sequence in response to the strings of quantization vectors; and 

an audio transducer (16, 17), coupled to the means for generating, to generate sound in response to the 
speech data sequence. 

14. The apparatus of claim 1 3, wherein the sound segment codes comprise data encoded using a first set (123) of 
quantization vectors (C p ), and the set (1 25) of quantization vectors (QV p ) having shaped quantization noise spectra 
is different from the first set of quantization vectors (C p ) but related to it according to the noise shaping filter function. 

15. The apparatus of claim 13 or 14, wherein the first set of quantization vectors represent quantization of filtered 
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sound segment data, and the means for generating a speech data sequence includes: 

means for applying an inverse filter to the identified strings of quantization vectors in generation of the speech 
data sequence. 

1 6. The apparatus of claim 1 5, wherein the inverse filter includes parameters chosen so that any multiplies are replaced 
by shift and/or add operations in application of the inverse filter. 

17. The apparatus of claim 13, 14, 15 or 16, wherein the means for translating includes a table of encoded diphones, 
having entries including data identifying a string of quantization vectors in the set for respective diphones, and the 
sequence of sound segment codes comprises a sequence of indices to the table of encoded diphones representing 
the text; and 

the means for identifying strings of quantization vectors includes means responsive to the sound segment 
codes for accessing the entries in the table of encoded diphones. 

is 18. The apparatus of any of claims 13 to 17, wherein the first set of quantization vectors represent quantization of 
results of linear prediction filtering of sound segment data, and the means for generating a speech data sequence 
includes: 

means for applying an inverse linear prediction filter to the identified strings of quantization vectors in gen- 
eration of the speech data sequence. 

19. The apparatus of any of claims 13 to 18, wherein the first set of quantization vectors represent quantization of 
results of pitch filtering of sound segment data, and the means for generating a speech data sequence includes: 

means for applying an inverse pitch filter to the identified strings of quantization vectors in generation of the 
speech data sequence. 

20. The apparatus of any of claims 13 to 19, wherein the means for generating a speech data sequence includes: 
means for concatenating the identified strings of quantization vectors and supplying the concatenated strings 

for the speech data sequence. 

21 . The apparatus of any of claims 1 3 to 20, wherein the identified strings of quantization vectors each have a beginning 
and an ending, and means for generating a speech data sequence includes: 

means for supplying the identified strings of quantization vectors for respective sound segment codes in se- 
quence; and 

means for blending the ending of an identified string of quantization vectors of a particular sound segment 
code in the sequence with the beginning of an identified string of quantization vectors of an adjacent sound 
segment code in the sequence to smooth discontinuities between the particular and adjacent sound segment 
codes in the speech data sequence. 

22. The apparatus of any of claims 1 3 to 21, wherein the means for generating a speech data sequence includes: 
means, responsive to the sound segment codes for adjusting pitch and duration of the identified strings of 

quantization vectors in the speech data sequence. 

23. The apparatus of claim 21 , further comprising: 
means, responsive to the sound segment codes for adjusting pitch and duration of the identified strings of 

quantization vectors in the speech data sequence. 

24. The apparatus of any of claims 1 3 to 23, further including an encoder including: 

a store for an encoding set of quantization vectors different from the set of quantization vectors used in de- 
coding; and 

means for generating the sound segment codes in response to the encoding set and sound segment data. 

25. The apparatus of claim 24, wherein the encoder further includes a linear prediction filter. 

26. The apparatus of claim 24 or 25, wherein the encoder further includes a pitch filter. 

27. An apparatus for synthesizing speech in response to a text, comprising : 



20 



25 



30 



35 



40 



45 



50 



55 



17 



EP 0 680 654 B1 



a programmable processor (10) to execute routines to produce a speech data sequence; 

an audio transducer (16,17) coupled to the processor, to generate sound in response to the speech data 

sequence; 

a table memory (1 5) coupled to the processor, storing a noise-shaped set (1 25) of quantization vectors (QV p ) 
produced by performing an inverse noise shaping filter operation on a first set (123) of quantization vectors, 
and a table of encoded diphones having entries including data identifying (23) a string of quantization vectors 
(QV p ) in the said noise-shaped set (125) for respective diphones; and 

an instruction memory (15), coupled to the processor, storing a translator routine for execution by the processor 
to translate (21 ) the text to a sequence of diphone indices, and a decoder routine for execution by the processor 
including 

means, responsive to diphone indices in the sequence, for accessing the table of encoded diphones to 
identify strings of quantization vectors (QV p ) in the said noise-shaped set (1 25) for diphones in the text; and 
means, coupled to the means for accessing and the table memory, for retrieving the identified strings of 
quantization vectors (QV p ); 

means, coupled with the means for retrieving, for producing diphone data strings in response to the iden- 
tified strings of quantization vectors, wherein the diphone data strings each have a beginning and an 
ending; 

means, coupled to the means for producing, for blending (24) the ending of a particular diphone data string 
in the sequence with the beginning of an adjacent diphone data string in the sequence to smooth discon- 
tinuities between the particular and adjacent diphone data strings to produce a smoothed string of quan- 
tized speech data; and 

means, responsive to the text and the smoothed string of quantized speech data; for adjusting (25, 26) 
pitch and duration of the identified strings of quantization vectors for the diphones in the sequence to 
produce the speech data sequence for supply to the audio transducer. 

28. The apparatus of claim 27, wherein the data identifying a string of quantization vectors comprise data encoded 
using the first set (123) of quantization vectors (C p ) and the set (125) of noise compensated quantization vectors 
(QV p ) is different from the first set (1 23) of quantization vectors (C ) but related to it according to the noise shaping 
filter operation. 

29. The apparatus of claim 27, wherein the first set of quantization vectors represent quantization of filtered sound 
segment data, and the means for producing diphone data strings includes: 

means for applying an inverse filter to the identified strings of quantization vectors. 

30. The apparatus of claim 29, wherein the inverse filter includes parameters chosen so that any multiplies are replaced 
by shift and/or add operations in application of the inverse filter. 

31. The apparatus of claim 27, 28, 29 or 30, wherein the first set of quantization vectors represent quantization of 
results of linear prediction filtering of sound segment data, and the means for producing diphone data strings 
includes: 

means for applying a inverse linear prediction filter to the identified strings of quantization vectors. 

32. The apparatus of any of claims 27 to 31, wherein the first set of quantization vectors represent quantization of 
results of pitch filtering of sound segment data, and the means for producing diphone data strings includes: 

means for applying an inverse pitch filter to the identified strings of quantization vectors. 

Patentanspruche 

1. Vorrichtung zum Synth etisieren von Sprache als Reaktion auf eine Folge von Sprache darstellenden Klangseg- 
mentcodes, die aufweist: einen Speicher (15), der einen Satz (125) von Quantisierungsvektoren (QVp) speichert, 
die geformte Quantisierungsrauschspektren aufweisen, wobei die Quantisierungsvektoren durch eine inverse 
Rauschformungsfilteroperation erzeugt werden, die an einem ersten Satz (123) von Quantisierungsvektoren (Cp) 
ausgefOhrt wird, die den Klangsegmentcodes entsprechen; 

Einrichtungen (299,10) die auf Klangsegmentcodes in der Folge ansprechen, zum Identifizieren (203) von 
Ketten von Quantisierungsvektoren im Satz (125) von Quantisierungsvektoren (QVp), die geformte Quanti- 
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sierungsrauschspektren fur jeweilige Klangsegmentcodes in der Folge aufweisen; 

Einrichtungen (10), die an die Einrichtungen zum Identifizieren und den Speicher (15) gekoppelt sind, zum 
Erzeugen (204,205,206) einer Sprachdatenfolge als Reaktion auf die Ketten von Quantisierungsvektoren; und 
einen Audiotransducer (16,17), der an die Einrichtungen zum Erzeugen gekoppelt ist, urn Klangals Reaktion 
auf die Sprachdatenfolge zu erzeugen. 

2. Vorrichtung nach Anspruch 1 , wobei die Klangsegmentcodes Daten aufweisen, die unter Verwendung des ersten 
Satzes von Quantisierungsvektoren codiert werden, und der Satz (125) von Quantisierungsvektoren (QVp), die 
geformte Quantisierungsrauschspektren aufweisen, vom ersten Satz (1 23) von Quantisierungsvektoren (Cp) ver- 
schieden ist, jedoch mit ihm entsprechend der Rauschformungsfilteroperation in Beziehung stent. 

3. Vorrichtung nach Anspruch 1 oder 2, wobei der erste Satz von Quantisierungsvektoren eine Quantisierung von 
gefilterten Klangsegmentdaten darstellt, und die Einrichtungen zum Erzeugen einer Sprachdatenfolge aufweisen: 
Einrichtungen zum Anwenden eines inversen Filters auf die identifizierten Ketten von Quantisierungsvektoren bei 
Erzeugung der Sprachdatenfolge. 

4. Vorrichtung nach Anspruch 3, wobei der inverse Filter Parameter aufweist, die so gewahlt werden, daG alle Mul- 
tiplikationen bei Anwendung des inversen Filters durch Schiebe-und/oder Addieroperationen ersetzt werden. 

5. Vorrichtung nach Anspruch 1 oder 2, wobei der erste Satz von Quantisierungsvektoren eine Quantisierung von 
Ergebnissen einer linearen Vorhersagefilterung von Klangsegmentdaten darstellt und die Einrichtungen zum Er- 
zeugen einer Sprachdatenfolge aufweisen; 

Einrichtungen zum Anwenden eines inversen linearen Vorher' sagefilters auf die identifizierten Ketten von Quan- 
tisierungsvektoren bei Erzeugung der Sprachdatenfolge. 

6. Vorrichtung nach Anspruch 1 oder 2 oder 5, wobei der erste Satz von Quantisierungsvektoren eine Quantisierung 
von Ergebnissen einer Tonlagenfilterung von Klangsegmentdaten darstellt, und die Einrichtungen zum Erzeugen 
einer Sprachdatenfolge aufweisen: 

Einrichtungen zum Anwenden eines inversen Tonlagenfi Iters auf die identifizierten Ketten von Quantisierungsvek- 
toren bei Erzeugung der Sprachdatenfolge. 

7. Vorrichtung nach einem der vorhergehenden Anspruche, wobei die Einrichtungen zum Erzeugen einer Sprach- 
datenfolge aufweisen: 

Einrichtungen zum Verketten der identifizierten Ketten von Quantisierungsvektoren und Liefern der verketteten 
Ketten fur die Sprachdatenfolge. 

8. Vorrichtung nach einem der vorhergehenden Anspruche, wobei die identifizierten Ketten von Quantisierungsvek- 
toren jeweils einen Anfang und ein Ende aufweisen, und Einrichtungen zum Erzeugen einer Sprachdatenfolge 
aufweisen: 

Einrichtungen zum Liefern der identifizierten Ketten von Quantisierungsvektoren fur jeweilige Klangsegment- 
codes in einer Folge; und 

Einrichtungen zum Mischen des Endes einer identifizierten Kette von Quantisierungsvektoren eines bestimm- 
ten Klangsegmentcodes in der Folge mit dem Anfang einer identifizierten Kette von Quantisierungsvektoren 
eines angrenzenden Klangsegmentcodes in der Folge, urn Diskontinuitaten zwischen dem bestimmten und 
angrenzenden Klangsegmentcode in der Sprachdatenfolge zu glatten. 

9. Vorrichtung nach einem der vorhergehenden Anspruche, wobei die Einrichtungen zum Erzeugen einer Sprach- 
datenfolge aufweisen: 

Einrichtungen, die auf die Klangsegmentcodes ansprechen, zum Einstellen von Tonlage und Dauer der identifi- 
zierten Ketten von Quantisierungsvektoren in der Sprachdatenfolge. 

10. Vorrichtung nach einem der vorhergehenden AnsprOche, die ferner einen Codierer aufweist, der aufweist: 

einen Speicher fur einen Codiersatz von Quantisierungsvektoren, der vom Satz von Quantisierungsvektoren 
verschieden ist, der beim Decodieren verwendet wird; und 

Einrichtungen zum Erzeugen der Klangsegmentcodes als Reaktion auf den Codiersatz und Klangsegment- 
daten. 
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11. Vorrichtung nach Anspruch 10, wobei der Codierer ferner einen lineareren Vorhersagefilter aufweist. 

12. Vorrichtung nach Anspruch 10 oder 1 1 , wobei der Codierer ferner einen Tonlagenfilter aufweist. 

13. Vorrichtung zum Synthetisieren von Sprache als Reaktion auf einen Text, die aufweist: 

Einrichtungen zum Ubersetzen von Text in eine Folge von Klangsegmentcodes; 

Einrichtungen zum Erzeugen eines Satzes (125) von Quantisierungsvektoren (QVp), die geformte Quantisie- 
rungsrauschspektren aufweisen, durch Anwenden einer inversen Rauschformungsfilterfunktion auf einen er- 
sten Satz (123) von Quantisierungsvektoren (Cp), die den Klangsegmentcodes entsprechen; 
einen Speicher (15), der den Satz (125) von Quantisierungsvektoren (QVp) speichert, die geformte Quanti- 
sierungsrauschspektren aufweisen; 

Einrichtungen (10), die auf Klangsegmentcodes in der Folge ansprechen, zum Identifizieren (203) von Ketten 
von Quantisierungsvektoren in dem Satz (125) von Quantisierungsvektoren (QVp), die geformte Quantisie- 
rungsrauschspektren aufweisen, fur jeweilige Klangsegmentcodes in der Folge; 

Einrichtungen (10), die an die Einrichtungen zum Identifizieren und den Speicher (15) gekoppelt sind, zum 
Erzeugen (204,205,206) einer Sprachdatenfolge als Reaktion auf die Ketten von Quantisierungsvektoren; und 
einen Audiotransducer (16,17), der an die Einrichtungen zum Erzeugen gekoppelt ist, urn Klang als Reaktion 
auf die Sprachdatenfolge zu erzeugen. 

14. Vorrichtung nach Anspruch 13, wobei die Klangsegmentcodes Daten aufweisen, die unter Verwendung eines er- 
sten Satzes (123) von Quantisierungsvektoren (Cp) codiert werden, und der Satz (125) von Quantisierungsvek- 
toren (Qvp), die geformte Quantisierungsrauschspektren aufweisen, vom ersten Satz von Quantisierungsvektoren 
(Cp) verschieden ist, jedoch mit ihm entsprechend der Rauschformungsfilteroperation in Beziehung steht. 

1 5. Vorrichtung nach Anspruch 1 3 oder 1 4, wobei der erste Satz von Quantisierungsvektoren eine Quantisierung von 
gefilterten Klangsegmentdaten darstellt, und die Einrichtungen zum Erzeugen einer Sprachdatenfolge aufweisen : 
Einrichtungen zum Anwenden eines inversen Filters auf die identifizierten Ketten von Quantisierungsvektoren bei 
Erzeugung der Sprachdatenfolge. 

16. Vorrichtung nach Anspruch 1 5, wobei der inverse Filter Parameter aufweist, die so gewahlt werden, daf* alle Mul- 
tiplikationen bei Anwendung des inversen Filters durch Schiebe-und/oder Addieroperationen ersetzt werden. 

17. Vorrichtung nach Anspruch 1 3, 1 4, 1 5 oder 1 6, wobei die Einrichtungen zum Ubersetzen eine Tabelle von codierten 
Diphonen aufweisen, die Eintrage aufweist, die Daten aufweisen, die eine Kette von Quantisierungsvektoren in 
dem Satz fur jeweilige Diphone aufweisen, und die Folge von Klangsegmentcodes eine Folge von Indizes auf die 
Tabelle von codierten Diphonen, die den Text darstellen, aufweist; und die Einrichtungen zum Identifizieren von 
Ketten von Quantisierungsvektoren Einrichtungen aufweisen, die auf die Klangsegmentcodes ansprechen, zum 
Zugreifen auf die Eintrage in der Tabelle von codierten Diphonen. 

18. Vorrichtung nach einem der Anspruche 13 bis 17, wobei der erste Satz von Quantisierungsvektoren eine Quanti- 
sierung von Ergebnissen einer linearen Vorhersagefilterung von Klangsegmentdaten darstellt, und die Einrichtun- 
gen zum Erzeugen einer Sprachdatenfolge aufweisen: 

Einrichtungen zum Anwenden eines inversen linearen Vorhersagefi Iters auf die identifizierten Ketten von Quanti- 
sierungsvektoren bei Erzeugung der Sprachdatenfolge. 

19. Vorrichtung nach einem der Anspruche 1 3 bis 18, wobei der erste Satz von Quantisierungvektoren eine Quanti- 
sierung von Ergebnissen einer Tonlagenfilterung von Klangsegmentdaten darstellt, und die Einrichtungen zum 
Erzeugen einer Sprachdatenfolge aufweisen: 

Einrichtungen zum Anwenden eines inversen Tonlagenfilters auf die identifizierten Ketten von Quantisierungsvek- 
toren bei Erzeugung der Sprachdatenfolge. 

20. Vorrichtung nach einem der Anspruche 1 3 bis 1 9, wobei die Einrichtungen zum Erzeugen einer Sprachdatenfolge 
aufweisen: 

Einrichtungen zum Verketten der identifizierten Ketten von Quantisierungsvektoren und Liefern der verketteten 
Ketten fur die Sprachdatenfolge." 

21. Vorrichtung nach einem der Anspruche 13 bis 20, wobei die identifizierten Ketten von Quantisierungsvektoren 



20 



EP 0 680 654 B1 



jeweils einen Anfang und ein Ende aufweisen. und Einrichtungen zum Erzeugen einer Sprachdatenfolge aufwei- 
sen: 

Einrichtungen zum Liefem der identifizierten Ketten von Quantisierungsvektoren fur jeweilige Klangsegment- 
codes in einer Folge; und 

Einrichtungen zum Mischen des Endes einer identifizierten Kette von Quantisierungsvektoren eines bestimm- 
ten Klangsegmentcodes in.der Folge mit dem Anfang einer identifizierten Kette von Quantisierungsvektoren 
eines angrenzenden Klangsegmentcodes in der Folge, urn Diskontinuitaten zwischen dem bestimmten und 
angrenzenden Klangsegmentcode in der Sprachdatenfolge zu glatten. 

22. Vorrichtung nach einem der Anspruche 1 3 bis 21 , wobei die Einrichtungen zum Erzeugen einer Sprachdatenfolge 
aufweisen: 

Einrichtungen, die ansprechen auf die Klangsegmentcodes, zum Einstellen einer Tonlage und Dauer der identifi- 
zierten Ketten von Quantisierungsvektoren in der Sprachdatenfolge. 

23. Vorrichtung nach Anspruch 21, die ferner aufweist: 

Einrichtungen, die ansprechen auf die Klangsegmentcodes, zum Einstellen einer Tonlage und Dauer der identifi- 
zierten Ketten von Quantisierungsvektoren in der Sprachdatenfolge. 

24. Vorrichtung nach einem der Anspruche 13 bis 23, die ferner einen Codierer aufweist, der aufweist: 

einen Speicher fur einen Codiersatz von Quantisierungsvektoren, der vom Satz von Quantisierungsvektoren 
verschieden ist, der beim Decodieren verwendet wird; und 

Einrichtungen zum Erzeugen der Klangsegmentcodes als Reaktion auf den Codiersatz und Klangsegment- 
daten. 

25. Vorrichtung nach Anspruch 24, wobei der Codierer ferner einen linearen \forhersagefilter aufweist. 

26. Vorrichtung nach Anspruch 24 Oder 25, wobei der Codierer ferner einen Ton lagenfi Iter aufweist. 

27. Vorrichtung zum Synthetisieren von Sprache als Reaktion auf einen Text, die aufweist: 

einen programmierbaren Prozessor (10), urn Routinen auszufuhren, urn eine Sprachdatenfolge zu erzeugen; 
einen Audiotransducer (16,17), der an den Prozessor gekoppelt ist, urn Klang als Reaktion auf die Sprachda- 
tenfolge zu erzeugen; 

einen Tabellenspeicher (15), der an den Prozessor gekoppelt ist, der einen rauschgeformten Satz (125) von 
Quantisierungsvektoren (QVp), diedurch Ausfuhren einer inversen Rauschformungsfilteroperation am ersten 
Satz (123) von Quantisierungsvektoren erzeugt werden, und eine Tabelle von codierten Diphonen speichert, 
die Eintrage aufweist, die Daten aufweisen, die eine Kette von Quantisierungsvektoren (QVp) in dem rausch- 
geformten Satz (1 25) fur jeweilige Diphone identifizieren (23); 

und einen Befehlsspeicher (15), der an den Prozessor gekoppelt ist, der eine Ubersetzerroutine zur Ausfuh- 
rung durch den Prozessor, urn den Text in eine Folge von Diphonindizes zu ubersetzen (21), und eine Deco- 
dierroutine zur Ausfuhrung durch den Prozessor speichert, die aufweist 

Einrichtungen, die auf Diphonindizes in der Folge ansprechen, zum Zugreifen auf die Tabelle von codierten 
Diphonen, urn Ketten von Quantisierungsvektoren (QVp) in dem rauschgeformten Satz (125) fur Diphone 
im Text zu identifizieren; und 

Einrichtungen, die an die Einrichtungen zum Zugreifen und den Tabellenspeicher gekoppelt sind, zum 
Wiedergewinnen der identifizierten Ketten von Quantisierungsvektoren (QVp); 

Einrichtungen, die mit den Einrichtungen zum Wiedergewinnen gekoppelt sind, zum Erzeugen von Di- 
phondaten ketten als Reaktion auf die identifizierten Ketten von Quantisierungsvektoren, wobei die Di- 
phondaten ketten jeweils einen Anfang und ein Ende aufweisen; 

Einrichtungen, die an die Einrichtungen zum Erzeugen gekoppelt sind, zum Mischen (24) des Endes einer 
bestimmten Diphondat en kette in der Folge mit dem Anfang einer angrenzenden Diphondatenkette in der 
Folge, urn Diskontinuitaten zwischen der bestimmten und angrenzenden Diphondatenkette zu glatten, 
urn eine geglattete Kette von quantisierten Sprachdaten zu erzeugen; und 

Einrichtungen, die auf den Text und die geglattete Kette von quantisierten Sprachdaten ansprechen, zum 
Einstellen (25,26) einer Tonlage und Dauer der identifizierten Ketten von Quantisierungsvektoren fur die 
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Diphone in der Folge, urn die Sprachdatenfolge zur Lieferung an den Audio wandler zu erzeugen. 

28. Vorrichtung nach Anspruch 27, wobei die Daten, die eine Kette von Quantisierungsvektoren identifizieren, Daten 
aufweisen, die unter Verwendung des ersten Satzes (123) von Quantisierungsvektoren (Cp) codiert werden, und 
der Satz (125) von rauschkompensierten Quantisierungsvektoren (QVp) vom ersten Satz (123) von Quantisie- 
rungsvektoren (Cp) verschieden ist, jedoch mit ihm entsprechend der Rauschformungsfifte rope ration in Beziehung 
steht. 

29. Vorrichtung nach Anspruch 27, wobei der erste Satz yon Quantisierungsvektoren eine Quantisierung von gefilter- 
ten Klangsegmentdaten darstellt, und die Einrichtungen zum Erzeugen von Diphondatenketten aufweisen: 
Einrichtungen zum Anwenden eines inversen Filters auf die identifizierten Ketten von Quantisierungsvektoren. 

30. Vorrichtung nach Anspruch 29, wobei der inverse Filter Parameter aufweist, die so gewahlt werden, da(3 aile Mul- 
tiplikationen bei Anwendung des inversen Filters durch Schiebe-und/oder Add ie rope rat ion en ersetzt werden. 

31. Vorrichtung nach Anspruch 27, 28, 29 oder 30, wobei der erste Satz von Quantisierungsvektoren eine Quantisie- 
rung von Ergebnissen einer linearen Vorhersagefilterung von Klangsegmentdaten darstellt, und die Einrichtungen 
zum Erzeugen von Diphondatenketten aufweisen: 

Einrichtungen zum Anwenden eines inversen linearen Vorhersagefilters auf die identifizierten Ketten von Quanti- 
sierungsvektoren. 

32. Vorrichtung nach einem der Anspruche 27 bis 31, wobei der erste Satz von Quantisierungsvektoren eine Quanti- 
sierung von Ergebnissen einer Tonlagenfilterung von Klangsegmentdaten darstellt, und die Einrichtungen zum 
Erzeugen von Diphondatenketten aufweisen: 

Einrichtungen zum Anwenden eines inversen Tonlagenfi Iters auf die identifizierten Ketten von Quantisierungsvek- 
toren. 



Revendications 

1. Dispositif pour synthetiser de la parole en reponse a une sequence de codes de segments de son representant 
de la parole, comprenant une memoire (15) enregistrant un ensemble (125) de vecteurs de quantification (QV p ) 
ayant des spectres de bruit de quantification mis en forme, les vecteurs de quantification etant produits par une 
operation de filtrage de mise en forme de bruit inverse realisee sur un premier ensemble (123) de vecteurs de 
quantification (C p ) qui correspondent aux codes de segments de son ; 

des moyens (299, 10), sensibles a des codes de segments de son dans la sequence, pour identifier (203) des 
chaines de vecteurs de quantification dans I'ensemble (125) de vecteurs de quantification (QV p ) ayant des 
spectres de bruit de quantification mis en forme pour des codes de segments de son respectifs dans la 
sequence ; 

des moyens (10), couples aux moyens d'identification et a la memoire (15), pour produire (204, 205, 206) une 
sequence de donnees de parole en reponse aux chaines de vecteurs de quantification ; et 
un transducteur (16, 17) audio, couple aux moyens de production, pour produire un son en reponse a la 
sequence de donnees de parole. 

2. Dispositif suivant la revendication 1 , dans lequel les codes de segments de son comprennent des donnees codees 
en utilisant le premier ensemble de vecteurs de quantification, et I'ensemble (125) de vecteurs de quantification 
(QV p ) ayant des spectres de bruit de quantification mis en forme est different du premier ensemble (123) de vec- 
teurs de quantification (C p ) mais est lie a celui-ci conformement a I'operation de filtrage de mise en forme du bruit. 

3. Dispositif suivant la revendication 1 ou 2, dans lequel le premier ensemble de vecteurs de quantification reprdsente 
la quantification de donnees de segments de son filtrees, et les moyens de production d'une sequence de donnees 
de parole component : 

des moyens pour appliquer un filtre inverse aux chaines identifies de vecteurs de quantification lors de la 
production de la sequence de donnees de parole. 

4. Dispositif suivant la revendication 3, dans lequel le filtre inverse comporte des parametres choisis de facon que 
d'eventuelles multiplications soient remplacees par des operations de decalage et/ ou d'addition dans ('application 
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5. Dispositif suivant la revendication 1 ou 2, dans lequel le premier ensemble de vecteurs de quantification represente 
la quantification de resultats d'un filtrage de prediction lineaire de donnees de segments de son, et les moyens 
de production d'une sequence de donnees de parole comportent : 

des moyens pour appliquer un filtre de prediction lineaire inverse aux chaTnes identifies de vecteurs de 
quantification dans la production de la sequence de donnees de parole. 

6. Dispositif suivant la revendication : 1 ou 2 ou 5, dans lequel le premier ensemble de vecteurs de quantification 
represente la quantification de resultais du filtrage de la hauteur de son de donnees de segments de son, et les 
moyens de production d'une sequence de donnees de parole comportent ; 

des moyens pour appliquer un filtre de hauteur de son inverse aux chaines identifies de vecteurs de quan- 
tification dans la production de la sequence de donnees de parole. 

7. Dispositif suivant Tune quelconque des revendications precedentes, dans lequel les moyens destines a produire 
une sequence de donnees de parole comportent : 

des moyens pour concatener les chaines identifies de vecteurs de quantification et fournir les chaines 
concatenees pour la sequence de donnees de parole. 

8. Dispositif suivant I'une quelconque des revendications precedentes, dans lequel les chaines identifies de vecteurs 
de quantification ont chacune un dSbut et une fin, et les moyens destines a produire une sequence de donnees 
de parole comportent : 

des moyens pour fournir les chaines identifies de vecteurs de quantification pour des codes de segments 
de son respectifs selon une sequence ; ete 

des moyens pour melanger la fin d'une chaine identifiee de vecteurs de quantification d'un code de segments 
de son particuliers dans la sequence avec le d6but d'une chaine identifiee de vecteurs de quantification d'un 
code de segment de son adjacent, dans la sequence, pour lisser les discontinues entre les codes de segments 
de son particulier et adjacent dans la sequence de donnees de parole. 

Dispositif suivant I'une quelconque des revendications precedentes, dans lequel les moyens destines a produire 
une sequence de donnees de parole comportent : 

des moyens sensibles aux codes de segments de son pour ajuster la hauteur de son et la duree des chaines 
identifies de vecteurs de quantification dans la sequence de donnees de parole. 

Dispositif suivant I'une quelconque des revendications precedentes, comportant en outre un codeur comportant : 

une memoire destinee a un ensemble de codage de vecteurs de quantification different de I'ensemble de 
vecteurs de quantification utilises dans le decodage ; et 

des moyens pour produire les codes de segments de son en r^ponse a I'ensemble de codage et aux de 
segments de son. 
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11. Dispositif suivant la revendication 10, dans lequel le codeur comporte en outre un filtre de prediction lineaire. 

12. Dispositif suivant la revendication 10 ou 11 , dans lequel le codeur comporte en outre un filtre de hauteur de son. 

13. Dispositif pour synthetiser de la parole en reponse a un texte, comprenant : 

des moyens pour traduire du texte en une sequence de codes de segments de son ; 
des moyens destines a produire un ensemble (125) de vecteurs de quantification (QV p ) ayant des spectres 
de bruit de quantification mis en forme par application d'une fonction de filtrage de mise en forme de bruit 
inverse a un premier ensemble (123) de vecteurs de quantification (C p ) qui correspondent aux codes de seg- 
ments de son; 

une memoire (15) memorisant I'ensemble (125) de vecteurs de quantification (QV p ) ayant des spectres de 
bruit de quantification mis en forme ; 

des moyens (10), sensibles a des codes de segments de son dans la sequence, pour identifier (203) des 
chaines de vecteurs de quantification dans I'ensemble (1 25) de vecteurs de quantification (QV p ) ayant des 
spectres de bruit de quantification mis en formz pour des codes de segments de son respectifs dans la se- 
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quence; 

des moyens (10) , couples aux moyens d' identification et a la memoire (15), pour produire (204, 205, 206) 
une sequence de donn6es de parole en r6ponse aux chaTnes de vecteurs de quantification ; et 
un transducteur (16, 17) audio, couple aux moyens de production, pour produire du son en reponse a une 
sequence de donnees de parole. 

14. Dispositif suivant la revendication 1 3, dans lequel les codes de segments de son comprennent des donnees cod6es 
en utilisant un premier ensemble (123) de vecteurs de quantification (C p ), et I'ensemble (125) de vecteurs de 
quantification (QV p ) ayant des spectres de bruit de quantification mis en forme est different du premier ensemble 
de vecteurs de quantification (C p ) mais est lie a celui-ci conformement a la fonction de filtrage de mise en forme 
du bruit. 

15. Dispositif suivant la revendication 1 3 ou 14, dans lequel le premier ensemble de vecteurs de quantification repre- 
sente la quantification de donnees de segments de son filtrees et les moyens destines a produire une sequence 
de donnees de parole comportent : 

des moyens pour appliquer un filtre inverse aux chaines identifies de vecteurs de quantification lors de la 
production de la sequence de donnees de parole. 

16. Dispositif suivant la revendication 15, dans lequel le filtre inverse comporte des parametres choisis de facon que 
d'eventuelles multiplications soient remplacees par des operations de decalage et/ou d'addition dans Implication 
du filtre inverse. 

17. Dispositif suivant la revendication 13, 14, 15 ou 16, dans lequel les moyens de traduction comportent un tableau 
de diphones codes, ayant des entrees comportant des donnees identifiant une chaine de vecteurs de quantification 
dans I'ensemble pour des diphones respectifs, et la sequence de codes de segments de son comprend une se- 
quence d'indices pointant sur le tableau de diphones codes representant le texte ; et 

les moyens ^identification de chaines de vecteurs de quantification comportent des moyens sensibles aux 
codes de segments de son pour acceder aux entrees dans le tableau de diphones codes. 

18. Dispositif suivant Tune quelconque des revendications 13 a 17, dans lequel le premier ensemble de vecteurs de 
quantification represente la quantification de resultats du filtrage de prediction lineaire de donnees de segments 
de son, et les moyens destines a produire une sequence de donnees de parole comportent : 

des moyens pour appliquer un filtre de prediction Iin6aire inverse aux chaTnes identifi6es de vecteurs de 
quantification lors de la production de la sequence de donnees de parole. 

19. Dispositif suivant I'une quelconque des revendications 13 a 18, dans lequel le premier ensemble de vecteurs de 
quantification represente la quantification de r6sultats du filtrage de la hauteur de son de donn6es de segments 
de son, et les moyens destines a produire une sequence de donnees de parole comportent : 

des moyens destines a appliquer un filtre de hauteur de son inverse aux chaTnes identifiees de vecteurs de 
quantification lors de la production de la sequence de donnees de parole. 

20. Dispositif suivant P une quelconque des revendications 13 a 19, dans lequel les moyens destines a produire une 
sequence de donnees de parole comportent : 

des moyens pour concatener les chaines identifiees de vecteurs de quantification et fournir les chaines 
concatenees pour la sequence de donnees de parole. 

21. Dispositif suivant I'une quelconque des revendications 13 a 20, dans lequel les chaines identifiees de vecteurs de 
quantification ont chacune un debut et une fin, et les moyens destines a produire une sequence de donnees de 
parole comportent : 

des moyens pour fournir les chaines identifiees de vecteurs de quantification pour des codes de segments 
de son respectifs en une sequence ; et 

des moyens pour meianger la fin d'une chaine identifiee de vecteurs de quantification d'un code de segment 
de son particulier dans la sequence avec le d6but d'une chaine identifiee de vecteurs de quantification d'un 
code de segment de son adjacent dans la sequence pour lisser des discontinuites entre les codes de segments 
de son particulier et adjacent dans la sequence de donnees de parole. 

22. Dispositif suivant I'une quelconque des revendications 13 a 21, dans lequel les moyens destines a produire une 
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sequence de donn6es de parole comportent : 

des moyens, sensibles aux codes de segments de son pour ajuster la hauteur de son et la dur6e des chaTnes 
identifies de vecteurs de quantification dans la sequence de donnees de parole. 

23. Dispositif suivant ta revendication 21, comprenant en outre : 

des moyens sensibles aux codes de segments de son pour ajuster la hauteur de son et la dur6e des chaTnes 
identifies de vecteurs de quantification dans la sequence de donnees de parole. 

24. Dispositif suivant I'une quelconque des revendications 1 3 a 23, comportant en outre un codeur comportant : 

une memoire destined a un ensemble de codage de vecteurs de quantification different de Pensemble de 
vecteurs de quantification utilise dans le decodage ; et 

des moyens pour g6n6rer les codes de segments de son en rSponse a I'ensemble de codage et aux donnees 
de segments de son. 

25. Dispositif suivant la revendication 24, dans lequel le codeur comporte en outre un filtre de prediction lineaire. 

26. Dispositif suivant la revendicaition 24 ou 25, dans lequel le codeur comporte en outre un filtre de hauteur de son. 

27. Dispositif destine a synthesiser de la parole en rdponse a un texte, comprenant : 

un processeur (10) programmable pour executer des sous-programmes pour produire une sequence de don- 
nees de parole ; 

un transducteur (16, I'll audio, couple au processeur, pour produire du son en r6ponse a la sequence de 
donnees de parole; 

une memoire (15) de tableau, couplee au processeur, enregistrant un ensemble (125) a bruit mis en forme 
de vecteurs de quantification (QV p ) produits en realisant une operation de filtrage de mise en forme de bruit 
inverse sur un premier ensemble (123) de vecteurs de quantification, et un tableau de diphones codes avant 
des entries comportant des donnees identifiant (23) une chaTne de vecteurs de quantification (QV p ) dans 
I'ensemble (125) a bruit mis en forme destine aux diphones respectifs ; et 

une memoire (15) destructions couplee au processeur, enregistrant un sous-programme traducteur destine 
a §tre execute par le processeur pour traduire (21) le texte en une sequence d'indices de diphones, et un 
sous-programme decodeur destine a etre execute par le processeur, comportant : 

des moyens, sensibles a des indices de diphones dans la sequence, pour acc6der au tableau de diphones 
codes afin d'identifier des chaTnes de vecteurs de quantification (QV p ) dans I'ensemble (125) a bruit mis 
en forme destine a des diphones dans le texte ; et 

des moyens, couples aux moyens d'acces et de memoire de tableau, pour extraire les chaTnes identifiees 
de vecteurs de quantification (QV p ) ; 

des moyens, couples aux moyens d'extraction, pour produire des chaTnes de donn6es de diphones en 
reponse aux chaTnes identifies de vecteurs de quantification, dans lequel les chaTnes de donnees de 
diphones ont chacune un d6but et une fin ; 

des moyens, couples aux moyens de production, pour meianger (24) la fin d'une chaTne de donnees de 
diphones particuli6res dans la sequence avec le debut d'une chaTne de donnees de diphones adjacente 
dans la sequence pour lisser les discontinuites entre les chaTnes de donnees de diphones particulidre et 
adjacente afin de produire une chaTne Iiss6e de donnees de parole quantises ; et 
des moyens, sensibles au texte et a la chaTne lissee de donnees de parole quantises, pour ajuster (25, 
26) la hauteur de son et la dur6e des chaTnes identifiees de vecteurs de quantification pour les diphones 
de la sequence afin de produire la sequence de donnees de parole destinee a etre fournie au transducteur 
audio. 

28. Dispositif suivant la revendication 27, dans lequel les donnees identifiant une chaTne de vecteurs de quantification 
comprennent des donn6es cod6es en utilisant le premier ensemble (123) de vecteurs de quantification (C ), et 
I'ensemble (125) de vecteurs de quantification (QV p ) a bruit compense est different du premier ensemble 023) 
de vecteurs de quantification (C p ), mais est lie a celui-ci conformement a Iteration de filtrage de mise en forme 
du bruit. 

29. Dispositif suivant la revendication 27, dans lequel le premier ensemble de vecteurs de quantification repr6sente 
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la quantification de donnees de segments de son filtr6s, et les moyens destines a produire des chaines de donnees 
de diphones comportent : 

des moyens pour appliquer un filtre inverse aux chaines identifies de vecteurs de quantification. 

s 30. Dispositif suivant la revendication 29, dans lequel le filtre inverse comporte des parametres choisis de facon que 
d'eventuelles multiplications soient remplac^es par des operations de decalage et/ou d'addition lors de I'application 
du fittre inverse. 

31 . Dispositif suivant la revendication 27, 28, 29 ou 30, dans lequel le premier ensemble de vecteurs de quantification 
10 reprSsente la quantification de resultats d'un filtrage de prediction lineaire de donnees de segments de son, et les 

moyens destines a produire des chaTnes de donnees de diphones comportent : 

des moyens destined a appliquer un filtre de prediction lineaire inverse aux chaines identifies de vecteurs 
de quantification. 

is 32. Dispositif suivant I'une quelconque des revendications 27 a 31 , dans lequel le premier ensemble de vecteurs de 
quantification represente la quantification de resultats du filtrage de hauteur de son de donnees de segments de 
son, et les moyens destines a produire des chaines de donnees de diphones comportent : 

des moyens destines a appliquer un filtre de hauteur de son inverse aux chaines identifies de vecteurs de 
quantification. 
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No. of Samples corresponding -to -the frequencies 
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